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m= Guide to SAE J3016 terminology | 
Hh, ing - 
e The bad Ze 
e The ugly 


e SAE J3076 is not a safety standard 


m The SAE Levels Explained 


e Perhaps not what you thought 
e Debunking some myths 





= A different way to look at automation modes 
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Basic SAE J3016 Terminology Niclon 


= ODD: Operational Design Domain meee 
Taxonomy and Definitions for 

e Environment system is designed to work within Terms Related to Driving 

m OEDR: Object and Event Detection and Response eed che oe 
e Monitoring & responding to driving environment 

= DDT: Dynamic Driving Task 
e Driving vehicle, performing OEDR, avoiding crashes 

= ADS: Automated Driving System 
e Computer system that can completely perform driving (DDT) 

= Fallback: 
e Operating vehicle when something goes wrong (e.g., ADS failure) 

m MRC: Minimal Risk Condition 


e Bringing vehicle to stop as part of fallback operation 
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SAE J3016 Levels Mellon 


University 
J3016 3 Steering 3 OEDR 3 DDT 3 Vehicle 3 Perform , 
Name | & Speed : : Failures : Failures : Fallback : 


No Driving 


‘ Driver : Driver : Driver : Driver’: : Driver 
Automation : ! ! ! ! ! 


Driver 
Assistance 


Split Driver : Driver 3 Driver 3 Driver 3 Limited : Driver 


Partial Driving 3 Auto- 


, Driver | Driver 3 Driver 3 Driver 3 Limited ' Driver 
Automation 3 mated : : | : : 


3 Conditional Driving 


ADS : 3 Driver : Driver : Limited : Driver 
Automation | . : | : 


High Driving 
Automation 


dhe ees 3 3 3 3 3 ' Unlimited | Driver 
Automation: 3 : : : | 
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Other J3016 Terminology Notes Shee, 
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= Automated vs. Autonomous 

e J3016: always uses “automated” with regard to ADS 

e ANSI/UL 4600: uses “autonomous’ for whole vehicle, not just ADS 
= Autopilot: 

e J3016: neither defined nor used 
= Robotic, Robotaxi: 

e J3016: do not use term 
= Driverless vehicle 

e J3016: do not use term, although “driverless operation” is OK 
= Self-driving 

e J3016: do not use term © 2021 Philip Koopman 5 
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Assistive Dydialare 
: mc nOlN 
Supervised ape eae 
PANU) Ko) pat-hnaye, eyes OFF 
ld alomaelle 
PANUh we) alo) palo) e t= No human 
olanyieie 


\V/=) aod (= W-\el ae) paleidleyemiviele (= 





https://bit.ly/3r1dhKE 
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Driver Roles Contrasted aa 





= Assistive & Supervised 
e Driver attention required 
— Vehicle responds to driver 
e Potential blame on automation for 
unsafe intervention 
— Incentivized to be conservative 





Vehicle Automation Modes 


https://bit.ly/3r1 dhKE 


= Automated & Autonomous 
e No human attention on driving 
— Vehicle cannot count on human intervention for driving safety 
e ADS potentially at fault for crashes, not human driver 
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Interpreting Vehicle Feature Names pee 
= ‘Autopilot’ systems: lane keeping + adaptive cruise control 
e Tesla “Autopilot” => SAE Level 2 / Supervised 
e Tesla “Full Self Driving’ => SAE Level 2 / Supervised 
e Porsche Taycan => SAE Level 2 / Supervised 
e Cadillac “Super Cruise” => SAE Level 2 / Supervised 
e ... others ... 


= Low Speed Automatic Lane Keeping System 
e UN Regulation No. 157 ALKS; traffic jam pilot under 60 km/hr 
e Announced but not confirmed deployments > Perhaps SAE Level 3 
— Either Supervised or Automated depending on driver responsibility 
= No constant human supervision 
e Waymo Robotaxi > Perhaps SAE Level 4/ Autonomous — o2021Philiokoopman 8 
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Top SAE J3016 Myths — 1 Mellon 
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= Myth: ODD means Geo-Fencing 
e Other factors: lighting, weather, infrastructure failures, ... 


m= Myth: Higher SAE J3016 Levels are necessarily safer 
e Nota safety standard! SAE Level 2 & 3 are problematic as defined 
— E.g., no requirement for driver monitoring 
e Higher levels introduce more automation, but not necessarily safety 
e “Level 2+’ is meaningless 


= Myth: Driver backs up ADS object detection in Level 3 
e Level 3 by definition handles 100% of OEDR 
e If driver can be blamed for not intervening while driving, that is Level 2 


https://users.ece.cmu.edu/~koopman/j3016/ 
© 2021 Philip Koopman 9 


Carnegie 


Top SAE J3016 Myths — 2 Mellon 
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= Myth: Level 3 always provides 10 seconds to take over 
e “at least several seconds’ ... no requirement that driver is ready 
e No warning time for “evident” vehicle failure 
e No requirement to maintain safety if driver does not take over 
— ADS that can always perform fallback is Level 4 


m Myth: Level 3 means “eyes off road” 
e ADS does whole DDT, but driver needs situational awareness 
— Example: ADS not required to handle tire blow-out 
e “Eyes off road” is in published graphics, but not in the standard 


https://users.ece.cmu.edu/~koopman/j3016/ = 
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Other Top AV Myths Niclon 
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= Myth: "94% of crashes are driver error’ NHTSA 
e Not what the US DOT study actually says. Benefits of Automation 


e Humans played somerole in 94% of crashes 


The safety benefits of automated vehicles are paramount. Automated 





on te vehicles’ potential to save lives and reduce injuries is rooted in one 

- Yes, drunk driving critical and tragie fact: SECS SEGU Geshe ar USOT 
A n @fron Automated vehicles have the potential to remove human error 

7 Yes, ot h e fs h U mM a Nn fra | It | es from the crash equation, which will help protect drivers and 


passengers, as well as bicyclists and pedestrians. When you consider 
—_ B ut a SO SO mM Ee th I Nn g S th at AVS WI | St ru g Gg le wit h more than 35,092 people died in motor vehicle-related crashes in the 


U.S. in 2015, you begin to grasp the lifesaving benefits of driver 


» “Recognition” and “Decision” errors assistance technologies. 


https://www.nhtsa.gov 
/technology- 


m= Myth: “AVs don't drive drunk, so they willbe safer" 9 "xazany" 
e AVs lack common sense; will make d/fferent mistakes 
e Insufficient data to know how this will turn out 
— Existing Level 2 data is human+machine safety, not autonomy safety 
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Summary Nici 
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m SAE J3016 is a terminology standards document 

e Not a safety standard 

e Defines levels that may not match what is actually built 

e Plenty of misleading and incorrect information circulating 

e Summary here: https://users.ece.cmu.edu/~koopman/j3016/ 


= Real vehicles might not exactly match Levels 


e Regulating or legislating using Levels is abadidea, ( es 
e Instead, concentrate on driver role & responsibility aa = 
— Clear statement of driver responsibility - t= = 





— Dont let people get used as a moral crumple zone aeniteieaiemies 
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